Maximum likelihood estimation of determinantal point processes
نویسندگان
چکیده
Determinantal point processes (DPPs) have wide-ranging applications in machine learning, where they are used to enforce the notion of diversity in subset selection problems. Many estimators have been proposed, but surprisingly the basic properties of the maximum likelihood estimator (MLE) have received little attention. The difficulty is that it is a non-concave maximization problem, and such functions are notoriously difficult to understand in high dimensions, despite their importance in modern machine learning. Here we study both the local and global geometry of the expected log-likelihood function. We prove several rates of convergence for the MLE and give a complete characterization of the case where these are parametric. We also exhibit a potential curse of dimensionality where the asymptotic variance of the MLE scales exponentially with the dimension of the problem. Moreover, we exhibit an exponential number of saddle points, and give evidence that these may be the only critical points. AMS 2000 subject classifications: Primary 62F10; secondary 60G55.
منابع مشابه
Step change point estimation in the multivariate-attribute process variability using artificial neural networks and maximum likelihood estimation
In some statistical process control applications, the combination of both variable and attribute quality characteristics which are correlated represents the quality of the product or the process. In such processes, identification the time of manifesting the out-of-control states can help the quality engineers to eliminate the assignable causes through proper corrective actions. In this paper, f...
متن کاملRates of estimation for determinantal point processes
Determinantal point processes (DPPs) have wide-ranging applications in machine learning, where they are used to enforce the notion of diversity in subset selection problems. Many estimators have been proposed, but surprisingly the basic properties of the maximum likelihood estimator (MLE) have received little attention. In this paper, we study the local geometry of the expected log-likelihood f...
متن کاملDrift Change Point Estimation in the rate and dependence Parameters of Autocorrelated Poisson Count Processes Using MLE Approach: An Application to IP Counts Data
Change point estimation in the area of statistical process control has received considerable attentions in the recent decades because it helps process engineer to identify and remove assignable causes as quickly as possible. On the other hand, improving in measurement systems and data storage, lead to taking observations very close to each other in time and as a result increasing autocorrelatio...
متن کاملChange Point Estimation of the Stationary State in Auto Regressive Moving Average Models, Using Maximum Likelihood Estimation and Singular Value Decomposition-based Filtering
In this paper, for the first time, the subject of change point estimation has been utilized in the stationary state of auto regressive moving average (ARMA) (1, 1). In the monitoring phase, in case the features of the question pursue a time series, i.e., ARMA(1,1), on the basis of the maximum likelihood technique, an approach will be developed for the estimation of the stationary state’s change...
متن کاملChange Point Estimation in High Yield Processes in the Presence of Serial Correlation
Change point estimation is as an effective method for identifying the time of a change in production and service processes. In most of the statistical quality control literature, it is usually assumed that the quality characteristic of interest is independently and identically distributed over time. It is obvious that this assumption could be easily violated in practice. In this paper, we use m...
متن کامل